Papers with Afrikaans language
Adaptation of Deep Bidirectional Transformers for Afrikaans Language (2020.lrec-1)
Copied to clipboard
| Challenge: | Pretrained language models can be trained in unsupervised manner, but can be difficult to implement because of the amount of data and computational resources needed for pretraining. |
| Approach: | They propose a model for Afrikaans based on bidirectional encoder representation from transformers. |
| Outcome: | The proposed model outperforms the existing models in part-of-speech tagging, named-entity recognition, and dependency parsing tasks. |